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Thi s paper is a summ a ry o f a ci uclv- longer evaluation repnrr vhicb sbniild 

apt'be published inasmuch as commitments of confidentiality were given to 
personnel 'in the projects studied, .There are, however, a number of generalized 
i,ssues in curricultn development arid implementation addressed in this study 
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summary and concluding chapters from our original final ''report to the National 
Science Foundation to make our research available for limited di^ius^ion. We 
trust that readers can accept the limitations that necessitate this abridgment. 
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A SUMMARY OF THE STUDY 

This -report presents the findings nr an extelWfal ev3lual;ion of eight NSF- \ 

Supported summer implementation projects focussing on the two programs of the 
Engineering Concepts Curriculm Project, The Han-Made World (TJjMW) and Technology- 
People>Environment (TPE). The study addressed a number of different questions: 
* How effective were the particular projects, in^achieving goals of the 
NSF Triple-I program? ' . 
* * Using the results of this evaluation,, what guidelines for project and 
participajBjt selectiga might be suggested to increase th^ probability^ 
of project sucbess^ 
. * If the projects observed in summer 1975 are treated as generally 
gg prggentrativ e of - pg^ — projects an d -pro blem s , doeg -^my j^i^84.^ em erg e ^— 



for understanding some of the -problems seemfftgly associated vith the . 
implementation of TMIf^-, a major curriculum development undertaking 
of NSF, but a program that, at this point, is apparently not ^widely 
adopted? 
Evaluation PJLan 

This study is seen as a part of a larger project,, an analysis of the 
experience of -one cohort of teachers with two programs which, make, because 
of content and pedagogy, unusual and complex defrtands both on teachers and 
schools, However, this study was a discrete undertaking inasmuch as it had 
as its primary focus understanding and evaluation of ^the eight TMMW-TPE ^ 
. Triple-Iv*p.roject;5 suppori^ed by NSF during summer ,1975. This narrower purpose 
would serve to provide a foundation for a planned larger undertaking. .in that 



it offers a. basis for an analysis of the variety of initial exposure to TMMW-TPE 

offered the cohort. 

An e^jcplanatory mo4el or a series of assumptions about school district and ^ 
individual currieular decision making forms the foundation ' for this study> The 
model assumes that, only teachers' with certain characteristics interest themselyes 
in a new program; that some of these teachers, as a result of a project experi- 
ence, decide to implement; and that where this initial implementation is success- 
ful, a 'school district might adopt— but that district adoption will be constrained 
by predictable characteristics of the district, and that successful adoption will 
be a function of support for* that district both from within and without. 

The primary goal of this study was to explicate thLs model as it bore on 
-TMMW/TPE and explore what role summet , project activity might play in the dissem- 
ination and adopt ion ^pro.cess. Time limitations imposed, severe constraints' on 
the full exploratioi;i of variables associated with this model ,and oi?iy project 
-participants were investigated Questionnaires were given participants probing: 

The source, of their information about 'TMtW/TPE. 

The .u^e of the programs in their school districts. 

The ii;"* educational and experiental backgrounds. 

Th^iir demographic characteristics. ^ • ' 

'•Their cotnftiitment to teaching and view of their work. , 

Their responses to their project experience. 

In addition, site, visits were conducted at all projects and, in the course of 

the^e visits, interviews were conducted with all project directors to explore 

t^ir perceptions of thfe nature of their implementation activity, 
i ♦ ^ * * 

Pependent Variables . , ^ ♦ 

f'; ■ ' 

Three dependent variables were explored; 
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The overall ef fectivenefss of a project qua project qua project. 
' The perception of participants had for use next year of TMMW/TPE. • 
This last criterion is, o£ course, -totally unsatisfactory inasmuch as most 
often plans, for progra'mase are made prior to attendance at a given project. 
As such this criterion reflects prior penetration rather than a specific project* 

^effect/ Clearly, if lise-as-a-result-of-a-project-experience is to be used as 
an ultimate criterion of pro ject. success, follow-up studiea of a single year 
cohort is required r Nevertheless, to the extent that prior decision-making 
can be r:egarded as an indicator of the impaction success of locally-originated 

. implementation programming— and all of the projects observed shourld be seen 
- iti this way— this criterion can serve, when used in conjunction with the 
narrower criteria, as a basis far evaluation of local program success, af 
a basis for diagnostic evaluation of the appropriateness of- the kind of 
programming observed, and for assessment of probable short-term impaction 
of that program in a local region or target system,^ 

Results * ' ^ / . . 

The stage of prior penetration of awareness of TMMW/TPE more than any 
other factor seemed to ef fect^roject success as defined in terms of any of 
the above criteria. When penetration is defined in terms of a phasic model 
that uses terms such as initial awareness, initial use, trial and implemen- 

tation, match between the target System state and the'^form ot-a- project ' s 
« > 

program seems to account for most of tHe variation between projects in 
success, Unsuccessful projects recruited participants -who had different 
.concerns that those of -the project's staff and different readiness to attend 
to a project's programs. Successful projects seemed to optimize matches, 
between the readiness states at the target systems and participant selection 
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and prograijming. Two programs were judged unsuccessful using ad intuitive 
sum of the above criteria, two more judged only moderately successful^ and 
four were judged successful. Of. the 198 participants, 65 participated in 
unsuccessful projects, 50 in moderately successful projects and *85 in 
successful projects. Using the strict criterion of igylemen tation of 
either -TMWy or TPE in 1975-76,^7 percent of participants in unsuccessful . 
projects were implementers,' 16 percent in the moderately successful projects, 
and 40 percent in the successful projects. If we intuitively assign weight- 
ings 'that derive- from assessments of success'ful progratnmi|ig,^ it would appear 
that a significant jproportion of the resources devoted to ECQP implemen- 
tation in 1975 wei;i spent ineffectively. 

' Within these broad findings about success, the following variables appear 
to account for the perceptions of individual participants of €h,e salience 'of 
TMMW/TEE to'^^them and* their statement about their pl^s for use of either program': 
A press on the 'part of their districts f or, u^e of the programs. 

Age and, experience--with more experienced teachers being more 
interested in the programs than less experienced teachers. 

Subject background— social Studies teachers were not adopters ^ 
and were not positive towards their experiences. , 

Investment in and satisfaction with teaching as a cateer. 

Commitment to a given school system that is, hd*ever,. modulated 
by characteristics suggesting cosmopolitaness-- number of graduate - 
schgpls attended, initial information about .programs, ani projects 
being gained from printed sources, etc. 

' . * 1' 

Eifher an intrir^ic 'iifterest in the programs or school-based 
press for use. 

Overall, it would appear that, if implementatipn is the goal ofi the ^ summer 
project .program, only^wo^ projects, with limited targeted' systems, played a 
significant part in aroactiTfr"l9bal implemiantation system. Two played a part 
ill a successful awareness-generating system, one (first-year) program might 
promise success in an ,awai:eness* system provided that appropriate subsequent 

ERIC . ^ 



activity took place, and three projects promised little (one continuing, two 
initial). The unsuccessful projects showed little promise in optimizing the 

interactions between their participants,, clienteles, and the conditions ^ 

» 

identified as being prerequisites fo;: systemic impaction. These projects 

did not have the characteristics associated with either ^infection" bf ^ 

target system -or support for developing awareness or implementation. ' ^ 

Implications ' ^ ^ ^ , . " 

It did^ot appear that either NSF guidelines for project selection or 

NSF administration af those guidelines was effective in producing-^Jro jects 

judged as successful. Indeed, if the projects observed can be judged as 
. ' * 
representative, it appeared as if NSF policy bore little* relationship to . 

events on'^the ground. Successful project' directors had all made, long term 

commitments^ to implementation programs and' used NSF programs as a .necessary 

fiscal ajld to their programming rather than as, a support fol: their endeavor. 

Indeed it would appear that, apart from funding, NSF implementation 

programming has played only a limited part in optimizing the conditions for 

effective trial implementation of TMMW. This suggests that the 'agency's 

policies may need to be re-tbought, particularly as they bear on imiilemenr 

tation of curricula which have "the characteristics of TMMW, i.e.,, curricula 

in areas ,which have no existing p^ace' in phe conventional high school program 

Existing policy seems^ to be framed withii?, a model which is designed tp'maxi-' 

mize the dissemination of u^at;ed versions of trad^ional curricula areas 

through &he school system and is, to this extent, predicated on the avails* 

ability of significant human and institutional resources which can be' turned 

to slightly different purposesi by the addition of marginal resources to th6 

school system by a national agency. This condition is not met in the case 
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of a curriculum such a? and, as a, result, when traditional cost-effective- 

ness criteria are used, thie program must be judged cost-ineffective. This fact, 
Vhen added to pi'^rg^amming that has probably produced projects of the varied '/ 
quality observed i/ Sumner 1975, raises the possibility that implementation ^ 



programining for curricula such as TMMW must be- re-conceived. The projects 
judged successful had .only 80 participants (Approximately) and only two (one 
of^he other projects was essentially a' national awareness project, the other 



was ^^Igional awareness project) were achieving significant local awareness 
stid implementation. J Even wiiiespread regional implementation requires more 
successful local ^impaction;tha*^pbsetved this suttmeir. If^these findings also 
' held j for pribjr years, th^ relative lack of implementation success of 'TM^i^^- 
becomes understandable and should, not, the study suggests, be judged to reflect 
an evaluation by ^JiQ schools of the curriculum 'itself . New implementation 
programs would seem to be^rll|j^ed, programs that are^ built on a more complete 
understanding s>f implementation a,t the local level and on the systemic impli- 
catiops of local decision-making tor th^ curriculuqi policy system. This task 
seems to require conceptual i^^at^ronrof ^projects as component s, both~~af~lrifo^r— — 



mation systems and teacher training systems— a distinction which seemed ambig- 
uous in the projects -observed— and an- undefr standing of the interactions, be- 
tween programs of one or both of these implied kitids and systemic impaction. 
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CONCLUSIONS AND IMPLICATIONS ■ 

This study" had" two grand purposes: (1) to address the policy problem of 
the cost-effectiveness of investment^ the National Science Foundation in the 
development and dlsset n tna t lo i l u f the curricdl^r^produe&s^^f a d e v elopment-group^ 
ECCP; and (2) to explore a preliminary way the general problem of the means', 
if any, by which potentially ^ddamental curriculum change takes place, in a 
national school system. Inevitably, of course, these purposes were and are 
intermingled: an assessment of the cost effectiveness of the ECCP development 
presumes, ultimately, that one can evaluate a set of given strategies as in • , 
principle appropriate ^(or inappropriate)' to the problem. ,To make thp*t judgment* 
one needs a ^conception of the means % which a given kind of change might take > 
place in the schools or might' be 'supported by a given policy thrust. 

This two- fold concern shaped the form o^ this study and its cpnclus ions. 



Chapter 3 sought to explore the policy paifSinet er s as soc ia t ed wi t h the sruccess 



of summer projects that had as their gQaJL.^tte--itrtrbdu<5t^^ the ECCP 



^ materials, using immediate adoption of the ^rOgrams'as the criterion. Chapter • 
4, sought to explore some pf the factors thai: seem to be 'associat^ with adoption 
by single teachers of TMMW. Not s^rprisingly , the conclusions of these two 
analyses were complementary. The existence of the program in a given LEA was 
fundamental to implementation success defined in the narrow terms we have been 
using; however, the analysis of the factors associated with ^individual' adoption 
decisions makes its own contribution by pulling out again 'some of the otl;ier 
factors that appeared in the project patterns; adopting teachers seem to be 

^ more invested in teaching than their project peers% they are less likely to be 
local in their career orientation, they tend to have attended more institutions 
for in-service education, and they tend to have more educational experiences than 
their peers., 

11 



This seems to represent an i*htuitively satisfying picture of the teachers 

• e 

one wodld expect to" ^e adopting a. program such as TM^^W.' ^When we add, as we 
did in Chapter 3, faci;ors like subject background, the picture becomes even 
more satisfying. But*what does this picture mean ? for understanding ot the 



implementation process in ^general? fo.r our understanding pf implementation of 
ECCP? for policy? ^ ' - -^^ . 

.These questions are disturbing. Even if we leave aside .the technical 
problems of analysis , ve must face two funciamental difficulties. All 
oj^ the teachers we ^studied were in the information field of TMMW; all were 
interested enough iny(he ^rpjec't to attend the project. Some atliended be- 
cause of pre^ure of some kind or other from their district to prepare for 
, use'^of the curricula,, others attended because the presence of thfe programs 
in their -environment made them curious about what JMMW/TPE mighff be, 'others 
attended because they were,, interested— a'nd we cannot, accoilnt fpr this curiosity, 
yet in the case of districts or communities- which had had no possibility of 
prior information about the programs, th:^s group becomes critical. They are, 
to use the epidemiological analogy that <xs being increasingly used to explore 
diss'emination of new ideas, potential injecting agents. 

The second difficulty is equally disturbing. The criterion in all of our 
analyses was», as we have emphasize^ .again and again, an implemetitation-next- 
year decision. But as we have .said, such a criterion^ confounds an entering 

j . ' " • ^ . ■ . ' ■ 

factor with a ^roject-outc.ome factor and With au iir^l^tutional feasability ,^ 
factor*. A more valid criterion for a project effect' requir/e^s that we (sxj^ore 
implementation when all part.icipants have had an, equal chance to implement: 

but* this is not* a realistic state; institutioiral factors, local' press, the 

' ' I ' ♦ 

qua'lity of folloV-up and later support 'by project p^ersonnel all effec't^in 
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clear ways the real possibility, and thus the probability o£ implementation. 

An additional problem associated with any usable criterion must also 
affect the task of assessment * Does offering either TMMW or-TPE as an elective 
represent implementation of these curricula? Thus, we can grant that any use 
bf the cttjrricula represents a legitimate use by the schools of an idea that has 
been offe^ the schools, but still wonder how important the problem-solving, 
multi-disciplinary view of engineering concepts implicit in the programs is in 
an assessment of implementation^ success. 

Again. this last concern is imponderable. Wirt and Quick (1975) suggest 
that - . ' 

national curriculum projects serve a vitally important planning ^ 
function in educatiorf! By this we 4o not mean planning in the 
deductive ^sense of developing an agenda of future activities from ^ , / 

lan assumed set of end objective^. Rather,, we mea.ii planning in 37 
the inductive sense of thinking about needed improvements in the ^ ^ 

substantive Equality of education, considering what is possible to 
do, and preparing for the- future^ by producing new curricula.- The 
net effect of - supporting curriculum development over a period of 
^years is the production of a body of curriculum resources thaf piece 
by piece are not only technological aids to edtKiational improvement 
but are in total an educational plan. During the^ development process " 
'both the individuaT curricula and the emergent plan become the^ sub- 
ject of public scrutiny through the channels- of the curriculum policy 
system. The widespread deliberations about new curricula or ^c^rrictilar 
ideas, ey^n when th^^y do not lead' to a decision not to adopt become 
as important 'for bringing afbout educational improvement as actual 
adoption of the new curriculum products produced (p. 50). 

Xps^^^**^*'^* ^^^^ plans can be exploited* as ideas. Others require 
demonstrations for a re^l. assessment of their utility and significance, and 

it is at least part of the^'purpose of a dissemination program of the kind we 

• ' ^ *'* . . 

observed this summer to establish demonstration 'sites. ^ ' . 

• This l^ads us- to the most vexing question any study of this kind must 

face. We can put the problem in terms* suggested by one pi'oject director. 

<* . ^ 

His goak was the creation of awar-eness in his region and saw one major dis- 

4^ . • - • • 
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function being 'associated with this goal—he sought widespread adoption as" ^ 
part of his dissemination program and he -achieved it in discrete sites in 
this region, but he achieved beginning major impactioK^n only one site. He^ 
believed he could have achieved such impaction in one or two major centers 
in his region, say in St. Louis and Decatur, but he wondered what such a 
pattern, means. ''So Decatur and St. Louis are using TMMM." How- can resources 
on the scale necessary to achieve impaction in these t;wo sites be provided to 
achieve implementation in Peoria, Indianapolis, Rockford, Quincy and Chicago. 
And. even if implementation occurred in these sites what would that mean? The 
ECCP programs make major demands on the curricular structures of the con- 
ventional school; they make major demands on the capabilities .of teachers. 
Even if we assume that a self-sustaining state were reached in Peoria, St. 
Louis, Decatur, etc, would the programs diffuse further^ without further 
active support by 'a sponsoring agency? Inasmuch as such a state has not 
been achieved outsiae perhaps the Tampa region,' we do not know; and what is 
happening "there has "not been systematically evaluated. There appear to be no 
precedents to guide even thoughtful reflection on this problem. Clearly the 
time frames required to reach such a potential state excede any- that have 
been u^d to date in curriculum implementation program. As Wirt,-«}d^ Quick ^ 

(1975) have noted 

Our analysis has shown that the products of national 
cui;iriculum .projects require a substantially longer time 
to spread broadly into education than the rate at which 
societal goals for education 'shift . Factors of delay 
include the more than five years required to develop 
a new curriculum, the, five year .life-cycle of the .book 
in the schools that places an upper limit on rates of 
adoption, and 'the more than ten years required for the 
content of nationally developed curricula to ^eep into 
the b^sal programs of |::ommercial publishers, (p. 49) 



Does bur experience offer any basis for a commentary of this task, 
'assuming that what we have been .suggesting above describes in cru<Je out- 
line the conditions necessary before major impaction of a program iike 
TMMW/TPE can be regarded as realistic? 

Quick and Wirt (1975) (See Figure 5,1) sugg^t that the^ curricular 
policy system includes as resource components: ^ 
• money for services 
products 

personnel", and r 
information 
as resource-providing institutions:' 

♦ 

' commercial publishing houses 
colleges of education 
other university departments and 

♦ 

curriculum .development centers 
and as regulating ihstitutions: 

national testing organizations 
state adoption boards > • 

teacher certification 

school accreditation. 

> 

What happens when we look at the implementation program we saw in ways 
suggested by this structure and the t;.ime and commitment frames suggested 
by Wirt and Quick's analysis of the complexity of the implementation task? 

First, time (or rather tim^-on-the-implementation-task) is clearly 
associated with even ir\|:ial penetration of TMMW. The- projects that had 



high level of awareness associated with them had all been activeiy engaged^ 
in implementatiop activity for several years. As important /all -of these * 
projects were directed by personnel who had attempted more or less systematic 
cally to operate on their systems* 'Both awareness of this need' to impact 
and sufficient time to achieve impaction seem to be necessary conditions for 
success defined in this -way. As important, the intensity of impact in a 
given locale seems to b6 strongly associated with the scale of the target 
area. One project focussed on'a Single city and saturation awareness, after 
five or so years, seemed De the outcome. Other projects focussetl on 
broader regions and achieved significant, but weaker iippact. ... 

Second, engagement in and with the system appears strongly, associated ^ 
with success., 'we have already noticed that given our perspective the source 
of an original systemic infection must "be regarded as randA. It seems clear, 
however, that subsequent activity and subsequent impact entails reaching less 
committed teachers and an institutional press on those teachers seems necessary 
for their actiye engagement with these curricula. The stages -be^tween the^e 
points seem classical (initial interest , 'awareness^ trial, evaluation, imple-* 
mentation) and follow, in rough outline the stages suggested by observers of - 
the "adoption" process such as Coleman ejt £l ♦ (1966)., Each movement between 
these stages requires its own strategies and active support by a facili- 
taing 'agent and agency. . When we reflect on the seven site^ we obse^rvjed, 
four seemed to have a sens*^e of this task and three ha,d little ^or no awareness. 

Only ih ope site, ho;7ever, did .the organizational context of the project 
activity seem to support the awareness of the project staff of 'their tansies*— -and 
that commitment seemed persona^ rather than 'institutional . In most sites ECXIP 



•13- 



B 
o 
u 



o 

P4 



o 

u 
u 

H 



«n 

u 
to 

U4 












c 






c 




to 






u 


4J 


u 


o 


CTJ 


C 


-v 


'J 


o 


o 


D 


00 






•< 







c 

o 

B 
C 

o 

u 

> 



o 
o 

CO 





(/) 




ct 




o 






. to 




c 


<0 


•H 


N 


XJ 




</) 


C 




c3 - 


H 


CO 








o 



1 1 




W 






o. 






a 


O 






c 




H4 





^ o 
^ O 

O O J-r 

o .r: ^ 

c u v; 

cn -J 



EMC 




c 

^) a. o 



c X 

CO C 
u o 

O 

a o 
u ^ 
c o 
u 



o 
o 
u 
o 
o 

o 
u 



t ft I 










w 








c 








o 


0) 




a 




















o 






N 




c 












c 
















Org 



















o 




o 






o 










0 


o 






cn 








Q 




H 
o 

fa, 



ERIC 



-L4- - * 

iiq)lementation activity was an add-on activity, a soft money venture without 
signrficant or monetary support from the institution itself. 

This last factor seems critical. Six sites were vested in schools of 
engineering or science: in one beginning site significant ^monetary support 
had been given for equipment purchase, in two others significant long-run 
personal support had been given by deans and the like, but the sustenance 
of primary missions in a period, of budgetary stress in one of these sites 
was beginning to require the diversion of resources away from the ECCP implemen- 
tation program. This ptobLem in a school of engineering is understandable in- 
asmuch as teacher education cannot be regarded as a primary mission of such a 
school* The problem is that in this sit^,« and in the other engineering-science • 
sites we investigated, 'no successful efforts had been made to transfer r^sponsi- 
bility for the ECCP program t4) the school of education, ^he logical site and 
source of long-term support for sch9pJU-ori^nrted''prografnming . It would seem 
that the very presence of a successful ECCP pr;pgram in a school of engineering 
should be regarded jas fortuitous," « ^ 

NSF fund iijig- policies seem to bear some tesp'onsibility for these problems. 
A decision to* vest a project in^a school of -eng^^neering would seem to raise 
the possibility of the personnel in that school neither understanding the* neierds 
of teaQhers nor the needs of the adoption system. To offer stimmer-f ocussed 
funding only would seem to pose the problem, that , where there was likely little 
understanding of the need for long-tertix folloy-up, activity wofflLd simply be 
summer-focussed » To continue funding education-rc^ussed activity in a school 
of engineering on a basically soft-money basis without a requirement that the • 
school demonstrate commitment by the allocation of local resources or signifi- 
cant incorporation of gchopl of education faculty raises the danger of the 
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termination. of i whole implemeritation program long before implemeptation is 
self-sustaining. ' • ' 

To return to the terms of the Wirt-Quick mpdel, it would seem that one 
^of the problems that ECCP Implementation programs have ^aced is a failure 
in resources provision: 'personnel with an understanding of and aotmnitment 
to the tasks associated with implementation have not 'been found in signi-fi- 
cant numbers, funding for the long run Servicing of implementation programs 
has^'not been provided, transfers of information and personnel have not b^en 
effected between those sites which. have been the prime sources of initial 
personnel resourcei and interest to those sites which would seem to have ' 
the resources, fiscVl, human, infS^tional, for .longer-run commitment to 

the programs. ^ . . - . - . 

. We have assumed that it is possible to talk of a self-sustaining impie- 
' mentation site. No such site exists .of course.. Training, however routine 

it 'might be /is a necessary part of the sustenance of ^ny implemetitatiori or 

a 

use activity, and to sustain implementation or use in a significant number 
of sites, the training requirements are considerable; It is inconceivable 
that a national agency with a finite budget should expect, or be expected, 
to support the training demands of Chicago and Peoria and Decatur and St. 
Louis and Rockford and Indianapolis. That task;must be undertaken routinely 
by existing training institutions to be conceivable, mast be undertaken ov6r 
long periods of time, and, to be. cost effective, must be seen as a part of 
existing training structures. No site we saw had beguji to face that problem;, 
annual funding made even tihe continuing existence, of a summer project 
activity problematic, institutional cost-sharing had not been secured to ease 
the burden on the national agency, existing training (and Incentive ^or 
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training) structures" had only* in one case been cp-opted. Giveti the long haul 

that musf be presumed to be a prerequisite of even a demonstration-focussed / 

intervention, these failures seem foolish. We ^ould argue that guidelines^ 

and programming must address this problem* The. task of resource provision * 

must be^ borne by more^ than the agency alone, if' not iri the beginning of an 

♦ * • 

•implementation, cer.tainly over the longer run* ^Given a finite allotment of 

implementation resources by NSF it would seem as important to concentrate 

on the total task of impaction on the curriculum* policy syatem (at least in 

a demonstration and trial mode} with the goal of securing the beginnings at' 

# 

least a self-sustaining implementation as it would to continue funding summer 
activity. This. is, of course, implicit in the school systems project category 
of the overall program we investigated, but it was not evident on the ground. 
And intuition and experience would suggest that the problems we have identified 
in the jeight projects we explored are found in many systems projects* They 
seem no 
observed < 

All of the remarks we have' been making to this point imply a failure of 
NSF programming to address the tasks we see associated with ECCP implemen- 
tation, problems which are potentially endemic to many o^,the second and third 
generattion projects in the NSF curriculum development program. Resource com- 
ponents, resource /provision gnd regulation have not been addressed with ^uffir 
cient; care and purpose for us to believe that the. potentiaL^of TMMW has, been 

showii^the schools. 

' / * 

'^ut this is/ a "judgnnfent based more on speculation than evidence. Equally 
fundamental problems appear to lurk in the structures which produced the mis- 
matches we observed between project types and the "needs" of the clienteles 



ER?C . ' ■ ■ 20 



less ad^hoc, no more systematically planful than do the projects we 



and systems/ from which participants emerged.. All of the participants we observed 
were interested to sosae degree in T^^^^W/TPE. But the form "of this interest varied 
widely, and systematica llj^^^^fcis variation was not reflected systematically in 
the character of the programs we saw, - . 

We suggest thala project can be conceptualized as functioning in two quite 
different ways: it can oe seen as a component of an information system or a com- 
ponent of a training system. Let us spend some time with this distinction. 

A decision to consider a program, to test a curriculum proposal experi- 
mentally, presumes knowledge of a possibility. A project such as the State 



Univerfity national leadership project was an examp.le primarily of an inten- . 
sive information dissemination activity:^ ready participants were given an 



opportunity to work through TEP, explore their questions about the program 
and. its components in an interactive mileiu, and so shape theix understanding 
of what the developers thoyght T]?E might be. The* participants at this project 
were familiar with TMMW and, to a higher degree than elsewhere, ,they secured 
their information about both the prpjept and the progrstm^ f rom print sources. 
They were ready in some sense for an intensive communication experience. The 
first SU project (a regional project) had some of these same qudli^ies, .but 
there the group of participants were more localite in their of i^n^;ation and 
had learned about the program from regionally pitched, person-dependent 
channels. These projects secured adoptions from committed , interested 
(or perhaps intrigued) teachers but they did not secure implementation. 
As the director^^ the SU project asserted again and again, he was focussing 
his intentions on and had begun to achieve awareness of TMMW/TPE, not 
implementation. He was beginning to build (or had built) an information fyLeld 
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not an implementation system. In this system implementation became a p-rocess 
that was initiated, and sustained by local "forces or by the reception' in the 
schools, themselves, of the programs, (Training in th^ sense that we will use 
that term below was a component of the US pirogram, of course. ^^6 are" ideal- 
typifying rather than describing.) 

If we conceptualize projects, as structures of a certain type within an^ 
information system two consequ^ences seem to follow. On the one hand we must 
ask what part a project as a subsystem of a special kind plays in the total i 
system, for what ends it is maximally useful, and under what conditions it plays 
its optimal role as a maximizer/of information flow of what range of types to 
its audiences. On the other hand, we must explore the relationship between 

information and implementation. Basically it is this last kind of concern 

'' ' ' » » 

which lies behirid the "preliminary analysis outlined in Chapter 4 where we 

sought to discern characteristics of teacjiers who responded positively to 
prior" awareness of the potential for them' of TMMW. Not surprisingly we found 
that^tho^e who characteristics would suggarst that* they we!t6 .potentially ipost 
^ receptiv^ to the implementation implications of information about possible 

new programs planned to use those programs. That this is tautological finding 
is, of course, only a small part of this problem. - 

If we* turn thi*s kind of conceptualization, of the nature of the projects , 
we observed to more explicitly practical, evaluative purposes, some clear bases 
for judgments of projects Seem to emerge. Thus, if we take, the least success- 
ful of the projects, it would sfeem l;hat we can account for their 'prob Jems 
largely in these terms. They reflect mismatches J^etween information needs 
and readinesses and modalities; the programming at Central State University 
constituted overload, the programming at Western S'tate University was 
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mistargetted: the group wanted basic information but received meta-infomiation, 
i.e., information about 'how more basic information might be transmitted. The 
» project at Central City University was mistatgetted inasmuch as the implement 
tation or an adoption readine'ss of. tho system, required a different audience. 
Atlantic Uriiversity offered infomatipn to a group that was, in some senses, 
relatively unwilling or unable to use it.' The messages of the Atlantic project 
were, to some extent, poorly pitched inasmuch as the group had. little readiness 

V 

! 

to hear of new "elective" science courses (the region was experiencing budgetry 
retrenchment) and perhaps little predisposition to attempt innovation. 

Successful projects were much more successful in optimizing the match 
between the needs of participants and their programming. Southern City re- 
cruited a. population who needed as much information about TPE es they could 



secure because their systems were pressing for use. Far West University had^ 
in some sense perfected its communicative capabilities vis-a-vis its group of 

interest with the result that there* was little .channel noise in. that system *and, 

, i , . ^ ^ ^ 

as a result of prior activity in the region, considerable readiness on the part 
of participants' for the messages. 

The notion of "readiness" invokes, of course, conceptions erf information 
systems as educative agencies, i.e., agencies wjaic^h. move the' cognitive or . 
affective states of participants towards either real or created* needs . Within, 
education or training systems the changes that are the goals of the' System are^ 
seen as taking place because o^ the characteristics of* the system itself', not , 

xir- ' " 

as a result of independent actions, primarily outside the system, undertaken 
by the student--although, of course, some readiness to enter instruction is \ 
required for success. • , ' < . ^ 
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, If we apply this kind of a. model to the projects we observed a different 
set of sorting categories and evaluative foci emerge: we would attribute out* 
comes to th^ training system itself, to its match n^ith the rISdinesses and 
capabilities of participants, its quality and efficiency as an instructional 

. system. Qpntext is, of course, important but it becomes in a sense peripheral 
to the pr^nary focus of the analysis— it becomes a means by which participants 

^ar.e recr|ltecl and a source of some of the barriers that will interfere with 

impleme^ation of learnings acquired in a project. As such, an instructional 

or educational conception of a project is a complement to a view oi ajproject 

as a c"Dmponent in an information system., ' 

A more or less standard set of descriptive and evaluative categories 
s ' ' 

emerges f rom »a model of this kind, and. not all of the' areas suggested by the 
model have been explored in this analysis.. One such area in particular 
troubled us and inasmuch as the kinds of programs we saw were, to some extent, 
a response to NSF policy, some discussion is perhaps warranted. 

Clearly the engi^neering concepts of the ECCI^ programs are not well under- 
stooa by teachers, most of whom have a basic science background. One project 
director saw. this .problem most cledrly from the first days of, his contact with 
participants and spoke to us at length about his concern- over tHe inabilities 
of teachers to tjtiink quan'^itatively., the hallmark, he thought, of the engineer* 
mind. He focussed much of his attention on this problem and although he was 
somewhat unsuccessful in coirounicating the idea of quantification to his 
participants he vas surely correct in -his assumption that unless teachers 
understood engineering concepts they Would not be able to teach these concepts 
effectively. The difficulties that the teachers would have with this program. 



as result of their cognitive problems wpjild surely lead to a degradation of 

. ^ * * \ 

the conceptual structure of the program, itself only one manifestation of the 

♦larger domain of engineering.^ncepts • We should riote that we saw aspects' 

Of this problem manifesting t^iemselves again and^ aga'in: at one project much 

time was spent on an airport landing pattern activity, and it seemed as if 

•the 9nly participant who had fa fim grasp on the problem (a^model of a real 

world problem) was a teacher 'who was an air force .reserve air traffic con-^ « 

troller. At another time it seemed to us that it was a retired naval engi- 
« 

neer participant who had the clearest capacity for moving readily with the 
ECCP materials and taking them further: he understood the lab equipment and 
seemed most able to see its potential and, perhaps, realize its ^.possibilities. 

We saw, however, far too little attention being given to this problem , 
area in the course of the summer. Indeed to the extent that projects^^pjilowed 
the increasingly widely understood prescription for inservice that ^teachers 
should experience the activities that were to offer their students ,. there 
seemed to be less attention to the problem of underlying theoretical or con- 
ceptual learnings Nowhere, given this point *of view, did there seem to be . 
an appropriate attention to engineering concepts. Given thisy ve wonder what 
the experience of teachers with the program in their schools might bring and 
how they might be buffeted by the demands of th^ir students ^nd their settings. 

It can well be answered that we are positing an unrealistic criterion for 
a summer project and we recognize this. But, in conceding this,, we come back 
to the analysis (derived from the worM of Wirt and Quick) that we offered, 
above. We caji grant the^ 1 imitations of a summer project format but still ask 
and expect that an implementation program in an area that is as problematic as' 
this one. engage the resource providing system more ex^tensively than has this 

7 . ■ 
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program. The only site at which this «'agagetnent (in the aspect that we are . 
Exploring here) appears to have taken place was at Southern City University* 
where a mastet's program addressing engineering concepts had been developed 
for teachers. Yet, the enrollments in this program are- small (currently, 
approxitpately 20) *in proportion to the needs even of the Southern City region. 

» • / * 

Some attention to this problem would seem to be a necessary part o£ 'the pl^jiing 
for the development of an implementation system designed to make a feysteraic 
impact even for demonstration purposes. And, in another vein", one cannot but ' 

speculate on the implications of the cognitive inadequacies we are presuming ^ 

^. • » ^» 

for the long run use patterns of TMMW in thjfe ^choolsv^ ' Teaching^ is a complex , - 

cognitive act: teachers, as Lortife (1974) fes noted, develop much of thefr 

cognitive capability in the course of their '6^n school experience with the 

* ' : . ' . ' ^ .A 

college experi^^e .serving* "to honerthat experience rather than replace it. 
What happens w*hen t 
teaching requires?^ 



What happens w*hen teachers do noL.have tl;ie^ognitive capisrBif ities that effective 



" * * * * 
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The thrust of our argument in this repor^t has ieea to suggest tha't, if 
this summer's ECCP implementation' program was representative of the programming 
of previous summers, it cannot be said that the ECCP implementation* program lias 
been effective, that some at least of the seeming problems of the prograTm are 
understandable and .begin at the point of initial dissemination. When the i 
problems that the schools, themselves, experience when t\\e^ seek 'to implement 
radically new programs, and when the tributions of ECCP itself are added to the 
pi^cture (a fuActioh of the program's history), an explanation of the* prog^ram's 
fragmentary success emer^^s very clearly. An approach to systemic impaction 
has not been seriously undertaken and such activity as there haB been cannot 
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be regarded as conceptually cost-effective. The $3. m/devoted to this effort 
have not been well *spent. , 

This conclusion is important both for an ass§^sment of the future of ECCP 
and for its implications for planning of implementation of other pr-Qgrams like 
TMMW and TPE (although we must note that' the problems facing TPE ii^lementation 
seem less awesome tfhan thqse .confronting TI^, if oply because it^has few' compe- 
titors for its potential niche in the .curriculum, a niche that all recognize 
needs attention). . S^NY (1975) and Wirt 'and Quick (1975) have both noticed- a 
marked difference between the original development* programs that initiated the 
c,urriculum movement of the 'sixties and the programs that have come, and are 
coming, to fruition in the 'seventies. These newer prpgrams (and TMMW is 
perhaps the prototype) do not have a natural ^►lace in the social system that 
is the curriculum of tfce American high school. The -danger is that ^tljey will 
experience the same implementation difficulties that TMMW has suffered' and 
that important, perhaps crucial curricular/resources, will not be. seeiuxi^ 
evaluated by the schools. The root of the problem will be,' we suggest, the ' 
implementation system inasmuch as it wilL not support in an appropriate way' 
the development. If they are to be 'successful, these projects need a new ' * 

' ' ■ ^ ' ! * 

kind of implementation system; one built upon a careful analysis and evalu- 
ation (more fundamental than that offered here) of the successes and failure 
of the existing system. Perhaps we can conclude this repoVt wi^Jh some re- 
flections orT this problem. 

In the years after the intial ifiovement of WF into secondary school 
curriculum development an implementation system haltingly emerged to majce 
av^Hable to the schools the products of development • (NSP, 1975). This 



system has evolved, of course, since its initiation in the mid-'f ifties, but 

its essential characteristics have remained constant: it was and is a system 

jdesigne4 to feed information and tra-ining into the -existing institutiots that 

constitute the curriculum of the secondary school. It was, and is, a system 

♦designed to update work done within existing subjects; it was not and is not 

a system designed to change those subjects in other than evolutionary ways._ 

SL^iffl^r institutes, academic year institutes, inservice insfitute^s and the 

like are settings ^designed both to move information about what might be done 

more quickly to teacher$ and to instruct teachers in the ways and means^ 

associated with new programs. Spin-offs of all kinds have occurred: there . 

have been changes in the practices of publishers and regulatory agencies, 

changes in the patterns of teacher education and the like~ttut'all of these 

changes must be seen as firmly embedded in the characteristics and forms of 

functioning of the existing service delivery system than is the school. All 

of the programs, and the responses of the educational system to these pro- 

^ . » f 

grams, must be seen as epiphenomenal inasmuch as they reflect the fjorras and 
the needs of the system. Programming has been most effective wlien it has 
most closely matched needs in the system, or in part#s of the system; when it 

has provided resources of information, programs *and ' funds whicTi permit the 

*• 

school system to actualize its own agendas, ' * 

Numerous criticisms can be made about the details of the functioning 
oi existing* mechanisms, for program implementation, bu.t we would argue that, 
in the main the programs -have achieved,' and are achieving, their purposes 
(McKinney and Westbury, t975; Wirt and Quick, ^ 1975) . The problem from our 
point of view rests with these purposes. They assume a more or less stfeady 



state, they assume physics and mathematics; they assume an existing institu- 
tional capability which can be impacted by essentially marginal. investments ■ 
in- innovative mechanisms — investments .which are successful in their achieving 

« 

their intents to the extent that they do, intact, match existing systemi- 
cally-derived needs. Where that match does riot exist (as in, say, elementary * 
school focussed programming) success becomes more problenoatic. 

This ar^ment focepjiadows our conclusion. "To. achieve even successful 
demons t rat-ion of the curricular potential (or the educational utility) of 
new programs (e.g. TMMW) , new institutions must be created; existing msti 
tutions and existing channels cannot do the job. .They Cannot assume^ exist in^ 
systemic investments in resources, nor can they draw upon the^ influence and 
'capabilities of the existing system. One consequence is seemingly prodigous^ 
expenditures for small gains inasmuch as there is only limited potential 
for multiplier effects. The programming' we observ.ed did not seem to recog- 
ni^e this problem and relied for it§ success on rajidom resppnseff of individuals 
and institutions. This i^ to be ejcpected, of course, inrfrthe beginnings of 
any programming that has the* patential of fundamental social change . But of 
systematic trail of a randojnly emerging possibility is legitimate goal of 
a national agency (and thiis is moot politically but not moot in principle), 
then purposive movement towards programming that produces (probabilistically) 
predictable outcomes must be initiated. Such outcome^s are not emerging, 
seemingly, from the existing programs. We may^be forgiven perhaps-^what 
follows is special pleading— for suggesting that such programming will ncft 
emerge full-blown from the heads of planners but instead will come about as 
programming responds both. to planning ,that acknowledges problems head on and 
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to incrementally successful social inventions that emerge in the marketplace 
The "goal, given a commitment to new forms, is ;aew social instituti6ns,, and 
each such ' institution must be* properly .seen, aa-an invention. Such respon- 
siveness will only emerge as an agency interacts reflectively with the 
marketplace that exists in .the multiple systems ♦that make up the nation's 
school system. And this conviction brings us back to oar study: three oT 
the projects. Far West Universi^ty, State University, and Southern City, 
seem to -show what caa%e achieved by random individuals working in randomly 
occurring sites: the task of the planner and the program manager is to make 
such occurrences less random. It is probably' unfair to suggest that these 
successes were occurring in spite of existing policy rather than as a result 

of those poricies— but something close to this was said by many of the 

It 

Ik. 

people we talked with this summer. 
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